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(54) Broadcasting apparatus and terminal apparatus for digital broadcasting service 



(57) A terminal apparatus for digital broadcasting 
outputs video and audio information based on a stream 
transmitted from a broadcasting station. The terminal 
apparatus stores a storage type stream transmitted 
from the broadcasting station in a storage unit and 
replaces part of a main stream transmitted from the 



broadcasting station with the storage type stream read 
out from the storage unit. The terminal apparatus stores 
or reads those streams based on control information 
correlated with those streams. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention s 

[0001 ] The present invention relates to a digital broad- 
casting system, a method for controlling digital streams 
and a receiving terminal apparatus (a so-called Interna- 
tional Receiver Decoder (IRD)). 

2. Description of the Related Art 

[0002] In a conventional broadcasting service, viewers 
watch a broadcasting program (contents) prepared In 
advanced by a broadcasting station by adequately 
selecting it with their receiver unit. Therefore, even 
though the viewers can select the broadcasting program 
per broadcasting station, they cannot individually select 
the contents composing the broadcasting program 
itself. 

[0003] In addition, the broadcasting service assuming 
the conventional ground wave is divided into a plurality 
of areas with the limit being the attainable range of the 
broadcasting radio wave output from a ground station. 
Accordingly, a so-called nation-wide network program 
broadcasted from a key station to the whole nation is 
generally composed of parts to be broadcasted to the 
whole nation and parts such as a commercial to be 
broadcasted to a local area. When a commercial or the 
like is to be broadcasted in a broadcasting program 
while broadcasting the main contents of the program 
from the key station, a control signal called a Q signal 
for inserting the commercial is transmitted and a local 
station receiving that signal broadcasts the commercial 
prepared in advance for the local area instead of a com- 
mercial for the key station at a predetermined timing. 
Accordingly, while such replacement allows a broad- 
casting service per specific area to be realized, its serv- 
ice range is the area per broadcasting station and a 
further personalized service cannot be provided. 
[0004] Meanwhile, in recent years, a satellite broad- 
casting service using broadcasting satellites is being 
provkied on a full-scale. With satellite broadcasting 
service, it has become possible to broadcast across a 
plurality of areas which had been covered by the 
respective ground stations in the past However, while 
satellite broadcasting allows the broadcasting service to 
be provided to a wide area with the same radio wave, 
there is a case when the contents of the program are so 
not necessary at all or the necessity thereof is very low 
for viewers of a specific local area depending on the 
contents thereof, and it is rather undesirable from the 
aspect of personalization of the service. 

55 

SUMMARY OF THE INVENTION 

[0005] The gist of the invention is to restructure a 



broadcasting program provided by a broadcasting sta- 
tion as a broadcasting program having different con- 
tents per viewer in a terminal apparatus of the viewer in 
order to realize the personalization of the digital broad- 
casting service. For instance, a broadcasting program 
provided by a broadcasting station is restructured in the 
terminal apparati^ of the viewer by replacing a part of 
the contents thereof with other contents according to 
the receiving area and preference of the viewer. 
[0006] The inventive terminal apparatus for digital 
broadcasting outputs video and audio information 
based on a transmitted individual stream. It reads a sec- 
ond individual stream (storage stream) stored in a stor- 
age unit instead of a partial stream composing a first 
individual stream (main stream) to output video and 
audio information in accordance with control information 
transmitted in correspondence with the first individual 
stream. 

[0007] The terminal apparatus stores the second indi- 
vidual stream to the storage unit in accordance with 
control information correlated with the transmitted sec- 
ond individual stream. 

[0008] The terminal apparatus also compares the first 
control information with terminal information specified 
by a user to extract the second individual stream stored 
in the storage unit corresponding to the result of com- 
parison. The terminal information is input by the viewer 
via inputting means or is transmitted as a stream. The 
terminal information may also be provided as a record- 
ing medium and be read from a readir^ unit. 
[0009] The invention also relates to a broadcasting 
unit In a digital broadcasting system for transmitting a 
multiplexed stream composed of a plurality of streams 
t^sed on the contents of a program to be broadcasted 
to the terminal apparatus of the viewer, comprising first 
control information appending means for con-elating first 
control information per partial stream composing a first 
individual stream; second control information append- 
ing means for correlating second control information per 
second individual stream; and stream generating 
means for generating a multiplexed stream based on 
the first individual stream correlated with the first control 
information and the second individual stream correlated 
with second control information. 
[001 0] It is noted that the video and audio information 
means not only both the video and audio information but 
also either one of the video and audio Information. Still 
more, text data such as characters is contained in the 
video information unless separately specified. 
[0011] The present invention allows a broadcasting 
program personalized per viewer to be structured and a 
finely personalized digital broadcasting service to bB 
realized. 

[001 2] The specific nature of the invention, as well as 
otiier objects, uses and advantages thereof, will clearly 
appear from tiie following description and from tiie 
accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] 

FIG. 1 is a block diagram shofwing overall whole s 
structure of a broadcasting system according to an 
embodiment of the invention; 
FIG. 2 Is a block diagram for explaining how to gen- 
erate a stream in a broadcasting station; 
FIG. 3 is a conc^ual diagram for explaining a io 
stream; 

FIG. 4A shows one example of broadcasting con- 
trol information and FIG. 4B shows one example of 
storage control information; 

FIG. 5 is a conceptual diagram for explaining is 

stream control of the invention; 

FIG. 6 is a block diagram showing the structure of a 

strecim management unit; 

FIG. 7 shows one example of terrhinal data; 

FIG. 8 is a flowchart for explaining the operation of 20 

a stream storage control unit to a storage stream; 

FIG. 9 is a flowchart for explaining the operation of 

the stream storage control unit to a main stream; 

and 

FIG. 1 0 is a f bwchart for explaining the operation of 25 
the stream storage control unit to the storage 
stream according to a second embodiment. 

DESCRIPTION OF THE PREFERRED EMBODI- 

r^ENTS 30 

[0014] Preferred embodiments of the Invention are 
explained below in detail with reference to the 
appended drawings. 

[001 5] The present embodiment presupposes mainly 35 
a digital broadcasting service. That is, a bit stream of 
digital data of encoded video data (video signal) and 
audio data (audio signal) is distributed to viewers via 
transmitting media and is decoded by a terminal appa- 
ratus to be output as images and sounds. Specifically, 4o 
the present emtKxjiment utilizes a technology of trans- 
mitting a plurality of streams as one stream by multiplex- 
ing them and of demultiplexing them. The MPEG 2 
standard has been known as such technology. Accord- 
ingly, the present embodiment will be explained by 45 
exemplifying the MPEG 2. 

[0016] The MPEG 2 presaibes a Transport Stream 
(MPEG 2-TS) for time-division multiplexing and trans- 
mitting a plurality of programs (stream: also called a 
program) in order to be conrtpatible with the digital so 
broadcasting service. Accordingly, the digital broadcast- 
ing service utilizing the MPEG 2-TS allows a channel to 
be selected and a stream to be separated further from 
the selected channel. Thus, the MPEG 2 is provided 
with a so-called multi-program compatibility for transmit- ss 
ting a plurality of programs as one stream. 
[0017] The MPEG 2-TS is transmitted by a transport 
stream packet (hereinafter refenred to as a TS packet^ 
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having a fixed length of 188 bytes. That is, a program in 
the digital broadcasting service is prescn'bed as a PES 
(Packetized Elementary Stream) of video and audio 
data. PSI (Program Specific Information) is also pre- 
scribed as information managing the PES. Atypical PSI 
includes PAT (Program Association Table). PMT (Pro- 
gram Map Table), NIT (Network Information Table). CAT 
(Conditional Access Table) and others. Each of these 
PSIs is transmitted in a section format. 
[0018] Control information (descrbed in detail later) in 
the present embodiment is configured as part of the 
stream and is transmitted as the TS packet similar to the 
video and audio data. In this case, the control informa- 
tion is preserved and transmitted in the PES format or 
the section format. 

[0019] The present embodiments refer to "ISO/IEC 
13818-1 Information technology-Coding of coding of 
moving pictures and associated audio information. 
MPEG SYSTEMS". "ISO/IEC 13818-2 MPEG VIDEO". 
^•ISO/IEC 13818-6 Digital Storage Media Command and 
Control, MPEG DSM-CC", "ISO/IEC 13818-7 Advanced 
Audio Coding, MPEG AAC" and "ATSC Doc. A53 Digital 
Television StandarcT. 

First Embodiment 

[0020] FIG. 1 is a block diagram showing the overall 
structure of a broadcasting system according to the first 
embodiment of the invention. As shown in the figure, 
this broadcasting system comprises a broadcasting sta- 
tion 1 1 0 for producing various programs and distrikxiting 
them to respective viewers as streams and a terminal 
120 for receiving the streams distributed (transmitted) 
from the broadcasting station 110 to output them as 
images and sounds. 

[0021] The broadcasting station 1 10 is provided witii 
a control information storage unit 1 1 1 for storing control 
information for controlling streams in the viewer's termi- 
nal 1 20, a program information storage unit 1 1 2 for stor- 
ing contents composing a main program itself and 
contents for the data broadcasting, a stream generating 
unit 113 for generating streams containing the control 
information and program information, and a transmitting 
unit 114 for b-ansmitting the generated streams to a 
txoadcasting satellite for example. 
[0022] The terminal 120 comprises a receiver 121 for 
receiving broadcasted radio (streams) from the broad- 
casting satellite or the like, an input unit 122 for inputting 
terminal data including viewer's personal data, a termi- 
nal data storage unit 123 for storing tiie terminal data 
input from the input unit 1 22, a stream management unit 
124 for managing the streams so that a program is pro- 
vided to the viewer in the end, a stream storage unit 125 
for temporarily storing the received streams and an out- 
put control unit 127 for controlling output units 126a and 
126b based on the stream sent from the stream man- 
agement unit 124. Here, the output control unit 127 
demultiplexes the streams into video and audio signals 
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by a demultiplexer (DEMUX) not shown and sends them 
to the output units 126a and 126b via respective decod- 
ers not shown. The output units 126a and 126b are a 
display unit for displaying images based on the video 
signals and a speaker for outputting sounds based on 5 
the audio signals. 

[0023] It is noted that although the streams are distrib- 
uted from the broadcasting station 1 10 to the terminal 
120 by the broadcasting satellite in the explanation 
described above, the present embodiment is not con- 10 
fined only thereto. For instance, the streams may be dis- 
tributed by a communication satellite. Further, the 
strearrs may be distributed not only through the satellite 
broadcasting but also through the ground wave broad- 
casting and through the so-called cable television is 
broadcasting (CATV). Internet and WAN (Wide Area 
Network). In short, any mode may be adopted as long 
as predetermined streams are transmitted to the 
viewer's terminal 1 20. 

[0024] FIG. 2 is a block diagram for explaining how to 20 
generate the stream in the broadcasting station 110. 
The control information storage unit 111 shown in FIG. 
1 has a broadcasting management data storage unit 
111a and an operation managemerrt data storage unit 
111b. The broadcasting management data storage unit 2S 
111a stores broadcasting management data including 
all control information contained in the streams to be 
transmitted. The operation management data storage 
unit 111b stores information necessary for actually 
broadcasting a program. I.e., information related to pro- so 
gram broadcasting starting time, broadcasting time and 
others, as operation management data. The operation 
management data is converted and prepared from the 
broadcasting management data by a converter unit not 
shown. The program information storage unit 1 12 con- 35 
tains main contents 112a composing a program to be 
broadcasted, storage contents 1 12b to be replaced with 
part or whole of the program and data broadcasting 
contents Il2c for data broadcasting. These contents 
are held in the program information borage unit 112 40 
normally as digital data. 

[0025] A control information appending unit 21a pro- 
duces the main contents appended with control infor- 
mation and sends them to an MPEG stream generating 
unit 22. That is, the control information appending unit 4S 
21a reads the main contents from the program informa- 
tion storage unit 112 to apperKi the control information 
to each part of the main contents shown in the broad- 
casting management data. Each part is a specific time 
zone, a commercial part and others within the program so 
for exannple. Each part corresponds to a partial stream 
described later. In the same manner, a control informa- 
tion appending unit 21b generates the storage contents 
appended with control information and control informa- 
tion appending unit 21c generates the data broadcast- ss 
ing contents appended with control information and 
sends them to an MPEG stream generating unit 22. 
[0026] The MPEG stream generating unit 22 gener- 
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ates each MPEG stream (denoted as MS, SS and DBS 
in the drawings) into which each control information 
appended content is compressed by the MPEG 2 for- 
mat based on the operation management data. The 
MPEG stream generating unit 22 also generates an 
MPEG stream (EPG) corresponding to program 
sequence information given from input means not 
shown. Each MPEG stream is time-division multiplexed 
by an MPEG multiplexing unit 23 and is sent to the 
transmitting unit 1 14 as the stream. 
[0027] FIG. 3 is a conceptual diagram showing one 
exemplary stream. The figure shows a state in which 
various individual streams are time-division multiplexed 
and are transmitted as one stream as a whole. 
[0028] In the figure, the main stream MS is video and 
audio data corresponding to each broadcasting pro- 
gram and broadcasting programs A and B are transmit- 
ted. There exists a time for assuring a switching time 
called SB (Station Break) between the respective 
broadcasting programs. Normally, a commercial ^ 
broadcasted during the SB. The storage stream SS is 
video and audio data provided to the viewers in place of 
at least part of the main stream MS or together there- 
with. The contents of a program, commercials or the like 
for a local area are transmitted by the storage stream 
SS. 

[0029] Program sequence information SI is informa- 
tion related to programs such as titles of programs 
scheduled to be broadcasted and broadcasting date. 
The data broadcasting stream DBS is a program pro- 
vided to the viewers in linkage with or independently 
from a broadcasting program in tiie data format. It is 
provided to the viewers in the mode of Internet Web 
pages. 

[0030] The main stream MS is composed of at least 
one partial stream. In concrete, the broadcasting pro- 
gram A is composed of partial streams A1 through A3 
and the broadcasting program B Is composed of partial 
streams B1 , ... The storage stream SS is composed of 
storage streams A21 through A23, S21 through S23 

and 621 tiirough B23 The storage streams A21 

through A23 correspond to the partial stream A2 of the 
main stream MS. In the same manner, the storage 
streams S21 through S23 correspond to the partial 
stream S and the storage streams B21 through B23 cor- 
respond to the partial str^m B2, respectively. Each of 
the storage streams SS is replaced w'rth the corre- 
sponding partial streams of the main stream MS in 
accordance with predetermined conditions. The corre- 
spondence of these streams is prescribed by control 
information described later. 

[0031 1 The partial stream of the main stream MS has 
broadcasting control information BC and each of the 
storage streams SS has storage control information SC. 
respectively. Each of the broadcasting and storage con- 
trol information BC and SC is information for controlling 
operating processes of the viewer's terminal 120. 
[0032] In the present embodiment, the video and 
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audio data of the main stream MS Is prescribed as PES. 
The video and audio data of the storage stream SS is 
also prescribed as private PES. Or, when it is video and 
audio data which may be viewed by viewers in advance, 
It is prescribed as PES. It Is also possible to prescribe 5 
the storage stream SS so as to transmit in the data 
broadcasting format. In such a case, it is prescribed in 
DSM-CC (Data Storage Media-Command and Control) 
section. 

[0033] Each control information BC and SC compos- 10 
ing a part of the stream is prescribed as a private sec- 
tion, is prescrit>ed in an adaptation field of the PES or in 
a reserve field within the PSI. Each of these storage 
control irrformation BC and SC may be prescribed within 
EU (Event Information table) or SI (Service Information) is 
used for recording with a timer. A link descriptor may be 
used for the broadcasting control information BC. The 
broadcasting control information BC may be transmitted 
in a data broadcasting stream 

[0034] FIGs. 4A and 4B show one example of the con- 20 
trol information. In corKrete. FIG. 4A shows one exam- 
ple of the broadcasting control information and FIG. 4B 
shows one example of the storage control information. 
[0035] The broadcasting control information has the 
following fields as shown in RG. 4A. ''Start" Is Informa- 25 
tion indicating that it is the head of a partial stream and 
designates broadcasting starting timing of contents of a 
program corresponding to that partial stream. "Cate- 
gory of Content" fe Information for discriminating a con- 
tent of the partial stream and gives information for 30 
discriminating a "telop". "commercial", "program" or 
"data broadcasting" for example. "Number" is an identi- 
fication number of each content discriminated by the 
category of the contents. 

[0036] "Compulsion" is information for forcibly causing 35 
the terminal 120 to process regardless of terminal data 
desaibed later. "Processing" is Information for desig- 
nating to replace the storage stream corresponding to 
the partial stream or to display in multiplex. It is noted 
that contents of the same kind are replaced with each 40 
other in case of "Replace", contents of the same or dif- 
ferent kind are displayed in multiplex in case of "Multi- 
plex Display". For instance, in case of the "Multiplex 
Display" of commercials, two commercials may be dis- 
played on a screen or a program and a commerdal may 45 
be displayed on the screen at tiie same time. In case of 
audio signals (audio stream), it is possible to arrange so 
that audio signals of a specified content is output by 
lowering the sound level of the main stream. 
[0037] "Time" Is information for designating broad- so 
casting time of a partial stream correspondir^ to a 
stream. Here. "Instant" is a designation for outputting 
the partial stream In real-time and it specifies outputting 
time when the stream is not to be output in real-time. 
"Return" is a designation of time requiring to return to ss 
the main stream even when the contents of a program 
corresponding to a partial stream is not finished. The 
"Return" also includes "Real-time" for forcibly returning 



to the main stream when the main stream comes to be 
transmitted. The designated time is based on time held 
in the viewer's terminal 120. The time held by the 
viewer's t©minal 120 is synchronized with a time stanp 
transmitted from the broadcasting station. 
[0038] "End" is information indicating tiiat the partial 
^ream is going to end. "End" Is used solely. 
[0039] Meanwhile, as shown in FIG. 4B, tiie storage 
corrtr ol information has the following fields That is. "Cat- 
egory of Content" is Information for discriminating a 
content of the storage stream, and gives information for 
discriminating a lelop", "commerdal", "program" or 
data broadcasting". "Number is an identification of 
each content discriminated by "Category of Content". 
[0040] "Target Category of Content" is information for 
specifying which content (number) the storage stream 
corresponds to. "Target Category of Conterrt" allows not 
only the same type of category like telops but also other 
type of categories to be designated. "Stream Length" 
gives the length of the stream. "Personalization" 
Includes "Area", "Sex", "Age" and "Weather". "Area" Is 
information indicating which broadcasting area Is an 
object of tiie storage stream. For instance, it may be 
information such as a zip code and an area code of a 
telephone number or a new code may be given per local 
area. 

[0041 ] "Sex" is information indicating an attribute such 
as the contents for men or for women. "Age" is informa- 
tion indicating an attribute such as the contents for 
infants or for adults. "Weather" is information indicating 
the contents of a program is related to weather. e.g., a 
commercial for a rainy day. 

[0042] "Compulsion" Is tiie same with tiie above-men- 
tioned broadcasting corrtrol information. "Processing" is 
information for designating processing Implemented by 
the viewer's terminal 120. In concrete, It designates an 
output mode (displaying method) or the like. 
[0043] "Effective Period" is information related to an 
effective term of the storage stream corresponding to 
the control information. It is information for disabling the 
use of stored storage stream again when its effective 
term runs out "Processing after Use" relates to 
processing after utilizing the storage stream. For 
instance, it designates to keep permanentiy or to scrap 
(erase). It is noted that it is also possiNe to be combined 
with "Effective Period" to designate scrapping at a stor- 
age stream whose effective period has passed. 
[0044] It is also possible to arrange so that the broad- 
casting control information BC holds the whole field 
given by the storage control information SC. 
[0045] Such control information is given on the broad- 
cast provider side (broadcasting station) in general and 
is distributed to the terminal 120 in the manner incorpo- 
rated in the stream. Then, the temninal 120 perforrr^ 
processing for controlling the broadcasting according to 
the contents designated for each field. 
[0046] one of characteristic points of tiie present 
embodiment is that the viewer's terminal 120 performs 
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information filtering to the multiplexed and transmitted 
streams based on the terminal data and that the 
viewer's terminal 120 restructures the final streams by 
using the streams which have been transmitted and 
stored. 

[0047] The control of the streams in the viewer's ter- 
minal 120 of the present embodiment is explained by 
using FIG. 5 for further clarification. FIG. 5 is a concep- 
tual diagram for explaining the control of the streams in 
the viewer's terminal 120 of the present embodiment 
[0048] At f irst» time<livision multiplexed and transmit- 
ted streams are demultiplexed per each stream. Each 
stream Is structured as a set of partial streams. While 
the partial stream of the main stream is normally sent 
for video arKi audio output, the partial stream of the stor- 
age stream is stored or extracted in accordance with its 
control information and personal data. The extracted 
partial stream is sent in the manner of replacing the par- 
tial stream of the main stream. The unnecessary partial 
stream of the main stream is neglected (abandoned). 
The sent partial stream is restructured as a stream for 
outputting video and audio and is provided to the view- 
ers as a broadcasting program via output units 126a 
and 126b. 

[0049] FIG- 6 is a block diagram showing the structure 
of the stream management unit 124. In the figure, a 
stream demultiplexing unit 61 demultiplexes the time- 
division multiplexed TS packets received via the 
receiver unit 121 per each stream and sends these to a 
stream control unit 62. The stream control unit 62 
extracts the control information from the TS packet conn- 
posing each stream and implements a process in 
accordance with the control Information per stream. In 
case of the storage stream, the stream control unit 62 
stores or extracts the TS packet composing the storage 
stream related to the control information to or of the 
stream storage unit 125 based on the control informa- 
tion and terminal data described later and sends this to 
a program stream structuring unit 63 (hereinafter 
referred to as a "PS information structuring unit 63"). 
whether it is the TS packet composing the storage 
stream related to the control information or not is 
decided based on PSI (Program Specific Information). 
In case of the main stream, the stream control unit 62 
sends the TS packet composing the main stream or the 
TS packet composing the storage stream extracted 
instead of the partial stream of the main stream to the 
PS information structuring unit 63 based on the control 
information thereof. The PS information structuring unit 
63 structures a program stream to be provided to the 
viewers as a broadcasting program from the TS packet 
composing the partial stream sent from the stream con- 
trol unit 62 and sends it to the output control unit 127. 
[0050] FIG. 7 is a table for explaining terminal data. 
While the terminal data is input mainly by the viewer 
from the input unit 122. it is possible to arrange so as to 
be input from the distributed stream or from a medium 
such as a CD-ROM. As shown in the figure, the terminal 



data comprises "Personalization", "Storage" and "Dis- 
play" and is constructed further hierarchically "Person- 
alization" con-esponds to the "Personalization" in the 
storage control information and designates personal 

5 information of the viewer himself. That is. "Area" is infor- 
mation related to the location where the viewer watches 
the broadcasting program and is designated by the zip 
code or telephone number. "Sex" is designated as 
"Male". "Female" or "None". "Age" is designated as 

70 "Year of Age" or "Age Group" for exanrple. Such infor- 
mation is conrpared with the storage control infornnation 
and in correspondence with the result of comparison, a 
program for male, a program for female or a program 
corresponding to the age group is selected. "Weather" 

75 is designated as "designated" or "None". These person- 
alization data have priority 

[0051] "Storage" Includes information related to "Ter- 
minal Control" "Search" and "Erase". "Terminal Control" 
is a designation for deciding whether or not to conply 

20 with "Processing" of the control information given on the 
broadcasting station side and, when complying, for con- 
trolling how to process. "Search" is information for des- 
ignating to search a specific video and audio data 
pattern (hereinafter refenred to as "specific pattern") 

25 appearing in the stream. Either or both of a video pat- 
tern and a audio pattern are specified as the specific 
pattern. "Erase" designates to erase streams. It is pro- 
vided to allow the viewer himself to designate to erase 
streams, even if they are the stored streams, to prevent 

30 an overflow because the storage capacity of the stream 
storage unit 125 is limited. 

[0052] "Display" is information for designating an out- 
put mode of streams given to the output units 126. The 
output modes include a designation of displaying 

35 "Replacement" or "Two Screen" and in case of replace- 
ment, designations of "size", "position" and others. 
These designations are input by the viewer via the input 
unit 122. are read as recording medium and are stored 
and held in the terminal data storage unit 123. 

40 [0053] Next, the operation of the stream control unit 
62 will be explained based on FIGs. 8 and 9. Because 
processing of the stream control unit 62 is different 
depending on whether the stream sent from the stream 
demultiplexing unit 61 is the main stream or the storage 

45 stream, the explanation is given below by dividing it into 
two parts. FIG. 8 is a flowchart for explaining the opera- 
tion of the stream storage control unit 62 with respect to 
the storage stream and FIG. 9 is a flowchart for explain- 
ing the operation of the stream storage control unit 62 to 

50 the main stream. 

[0054] In FIG. 8. the stream control unit 62 decides at 
first whether or not the packet sent is the storage control 
information in STEP 81. When it is decided to be the 
control Information in STEP 81 , the stream control unit 

55 62 decides whether or not there is a designation of 
stream filtering control in the "Terminal Control" field by 
making reference to the terminal data in STEP 82. 
When it is decided to be filtering in STEP 82, the stream 
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control unit 62 collates to the "Personalization" field of 
the termina! data stored in the terminal data storage unit 
123 and decides whether or not the corrterrts of the 
"Personalization" in the terminal data coincides with the 
"Personalization" of the control Information in STEP 84. 
When it is decided that they coincide in STEP 84, the 
stream control unit 62 outputs a partial stream related to 
the control Information to the stream storage unit 125 in 
STEP 85. For instance, when the "Personalization" of 
the control inforniation specifies "Tokyo" and when the 
"Personalization" of the terminal data also designates 
"Tokyo", the storage stream related to the control infor- 
mation is stored. It is noted that when priority is given to 
the "Personalization* of the terminal data, it is decided 
whether or not to store it in accordance with the priority. 
[0055] Meanwhile, when it is decided that they do not 
coincide in STEP 85. the partial stream related to the 
control information is neglected (abandoned) in STEP 
86. Thereby, the storage stream required by the viewer 
is stored in the stream storage unit 125 based on the 
personal information in the terminal data. 
[0056] Next the operation of the stream control unit 
62 in case of the main stream is explained below. In 
FIG. 9, the stream control unit 62 decides at first 
whether or not a packet concerned is broadcasting con- 
trol information in STEP 91 . When it is decided to be 
control information in STEP 91 . the stream control unit 
62 collates to the "Processing" field within the control 
information to decide whether or not that area is 
"Replacement" in STEP 92. When it is decided that it Is 
not "Replacement" in STEP 92. the stream control unit 
62 decides whether or not it is "Multiplex Display" in 
STEP 93. When it is decided that it is "Multiplex Dis- 
play", the stream control unit 62 sets displaying param- 
eters set in advance. "Display" stored in the terminal 
data storage unit 123 is normally preferentially applied 
as the displaying parameters and when there is no des- 
ignation. "Display" belonging to the main stream and 
"Display" belonging to the partial stream stored in the 
stream storage unit 125 are searched and set in this 
order. 

[0057] After setting the displaying parameters or when 
it has been decided in STEP 92 that it is "Replacement", 
the stream control unit 62 collates the "Compulsion" 
f iekJ to decide whether or not it is "Compulsion" In STEP 
95. When it is decided that it is not "Compulsion" in 
STEP 95, the stream control unit 62 collates the termi- 
nal data storage unit 123 and decides whether or not 
"Display" is given to the terminal data in STEP 96. That 
is. when it is not "Compulsion", the right for designating 
the storage stream to be displayed and the output mode 
of the storage stream Is given to the viewer. When it Is 
decided that it is "Compulsion" in STEP 95 or when it is 
decided that there is a designation in the terminal data 
in STEP 96. the stream control unit 62 collates the 
stream storage unit 125 to decide partial streams of the 
main stream corresponding to the control information 
whether or not a partial stream for replacement is stored 
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in STEP 97. When rt Is decided that the partial stream is 
^ored in STEP 97, the stream control unit 62 extracts 
the partial stream for replacement from the stream stor- 
age unit 125 in STEP 98. 
5 [0058] Thus, the stream control unit 62 designates the 
partial stream to be broadcasted based on the control 
information of the main stream and selects the parame- 
ters for controllir^ the display 

[0059] As described alxsve, according to the present 

10 emtxxfiment, only the streams required by the viewer 
are stored, tt then enables only information truly 
required by the viewer to be provided to the viewer with- 
out omissbn. Because no stream not required by the 
viewer is stored or displayed in this case, the memory 

IS on the terminal side may be used efficiently. 

[0060] Because the stream to be stored is transmitted 
and stored prior to the correspond ng part of the main 
stream, it may be provided to the viewer by being 
extracted at any time in necessary timing. 

20 [0061 ] Still more, t^cause the viewer's personal infor- 
mation such as "Area" is contained in the control infor- 
mation, it becomes possible to store and display the 
stream which meets witii the taste of the viewer. 
[0062] Meanwhile, the present erritxdiment enables a 

25 nation-wide program and a local program to be transmit- 
ted through the same transmission path even when a 
wide area broadcasting media such as a satellite broad- 
casting is employed. 

[0063] Further, a stream which has been stored may 
30 be utilized again for a stream to be repeatedly transmit- 
ted by specifying the storage stream to be kept perma- 
nently by the control information. It allows an 
information amount to be originally transmitted to be 
reduced and the broadcasting band to be effectively uti- 
35 lized. 

[0064] Although the flows of the processing opera- 
tions have been explained sequentially In the embodi- 
ment described above, the present embodiment is not 
confined only thereto. Accordingly, the procedure of the 
40 processes may be switched or the operations may be 
processed in parallel as long as ho contradiction occurs 
in the processing operations. 

[0065] Still more, although the above emfcxxJiment has 
been explained on the premise of being in conformity to 
45 MPEG 2, it may be what is in conformity to MPEG 4. 

Second Embodiment 

[0066] The second embodiment is characterized in 
so that when a specific pattern appears in a storage 
stream, the storage stream is controlled. 
[0067] FIG. 1 0 is a flowchart for explairdng the opera- 
tion of the stream control unit 62 performed on the stor- 
age stream. In the figure, processes from STEP 1001 
55 through STEP 1 006 are the same with those processed 
in the first embodiment shown in FIG. 8. 
[0068] At first, the stream control unit 62 decides 
whether or not a packet concerned is storage control 
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information In STEP 81 . When it is decided that it is not 
control information, the stream control unit 62 collates 
"Search Specification" to decide whether or not there Is 
the designation of search of the specific pattern In 
STEP 86. It is implemented not by including information 
related to a designation such as storage within the con- 
trol information but by correlating the information related 
to the d^ignation of storage in the specific pattern in 
the information related to video and audio data broad- 
casting. When it is decided in STEP 86 that the specific 
pattern is designated, the specific pattern is extracted 
from the stream related to the control information con- 
cemed in STEP 87. Next, the stream control unit 62 
decides whether or not storage of the extracted specific 
pattern is specified by the specific pattern In the termi- 
nal data in STEP 88. When it Is decided that the storage 
is designated in STEP 88, the stream control unit 62 
generates the storage control information SC based on 
the terminal data storage unit 123 to add the storage 
control information to the storage stream and adds "Fil- 
tering" to "Terminal Control" In STEP 1010. Then, the 
process advances to STEP 1003. The processes on 
and after STEP 1003 are the same with those in the first 
embodiment. 

[0069] As described above, the present embodiment 
allows the storage of the stream to be controlled based 
on the specific pattem appearing in the stream. 
[0070] It Is noted that "Search" to the specific pattern 
may be Input to a specific pattern designated by the 
broadcasting station in advance by using the Input unit 
122. It is also possible to arrange so as to allow the 
viewer to make "Storage" on a specific pattern when the 
specific pattern appears on a screen in which a program 
is broadcasted. 

Other Embodiments 

[0071 ] Each of the enrtKxJiments described above is a 
mere illustration for explaining the invention and is not 
intended to limit the invention to such embodiment. 
Accordingly, the invention may be errtoodied in various 
modes witiiout departing from its gist. 
[0072] For exanrple, altiiough tiie embodiments 
described above have been explained so as to replace 
part of the main stream for TV broadcasting witii a stor- 
age stream, the Invention is not specifically limited to 
such a case. Accordingly, the invention may be applied 
also to data broadcasting. It is possible to transmit a 
data broadcasting stream (corresponds to the main 
sti-eam) and a storage data broadcasting stream (corre- 
sponds to tiie storage stream) to be transnnitted and dis- 
played in real-time and to replace tiie data broadcasting 
sti-eam with the storage data broadcasting stiream in 
accordance witti control information and terminal data 
transmitted together with tiiese streams. 
[0073] A plurality of individual streams need not be 
transmitted as one multiplexed stream. In short, it will do 
if the plurality of individual sti^eams are transmitted to 



the viewer's terminal. When the terminal apparatus has 
a function of receiving a plurality of multiplex streams 
simultaneously, the main stream and its conresponding 
storage stream may be included in the different multi- 
5 plexed streams. It Is also possible to an-ange so as to 
provide the storage stream by a recording medium such 
as CD-ROM and DVD. 

[0074] Still more, cryptograph may be included in tiie 
control information. The terminal apparatus compares 

10 cryptographic information in the terminal data of the 
viewer with the cryptographic information within tiie 
stream and conducts the storage and replacement only 
when the result of comparison shows their coincidence. 
[0075] The invention may also be realized by execut- 

15 ing a program having the predetermined functions by a 
computer. The program is recorded on a recording 
medium, thus composing a programmed product. The 
computer includes a so-called microcomputer which 
performs predetermined processes by interpreting by a 

20 so-called central processing unit i.e., by CPU and MPU. 
The recording medium includes a memory such as a 
RAM and a ROM besides a hard-disk (HD), a DVD- 
RAM, a flexible disk (FD) and a CD-ROM. 
[0076] The entire disclosure of Japanese Patent Appli- 

25 cation Na 10-184431 filed on June 30. 1998 including 
specification, claims, drawings and summary are incor- 
porated herein by reference in its entirety. 

Claims 

30 

1 . A terminal apparatus, comprising : 

stream control means for controlling an individ- 
ual stream based on control Information corre- 
35 lated with the Individual stream; and 

output control means for outputting the individ- 
ual stream conti^olled by said stream control 
means to an output unit 

40 2. The terminal apparatus according to Claim 1, 
wherein said stream control means includes 
exti-acting means for extracting a second individual 
stream from a storage unit based on control infor- 
mation conrelated with a partial stream composing 

45 a first individual stream. 

3. The terminal apparatus according to Claim 2, 
wherein said stream control means includes struc- 
turing means for structuring a new individual stream 

so by modifying tiie partial sfream composing tiie first 
individual stream witii the extracted second individ- 
ual stream. 

4. A terminal apparatus, comprising: 

55 

a demultiplexer for demultiplexing a transmitted 
multiplexed sti-eam into a plurality of individual 
streams; and 
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stream control means for outputting a first indi- 
vidual stream within said plurality of individual 
streams demultiplexed by said demuttiplexer to 
an output unit and outputting a second individ- 
ual stream within said plurality of individual 5 
streams to a storage unit 

5. The terminal apparatus according to Claim 4, 
wherein said stream control means replaces a par- 
tial stream composing said first individual stream 10 
with the second individual stream which has been 
trar^mitted temporarily prior to said partial stream 
and stored in said storage unit based on control 
information correlated with said first irxJividual 
stream to be structured as a new first individual 75 
stream. 

6. A terminal apparatus, comprising: 

a receiver unit for receiving a transmitted multi- 20 
plexed stream; 

a demultiplexer for demultiplexing the multi- 
plexed stream received by said receiver unit 
into a plurality of individual streams: 
an output unit for outputting video and/or audio 2S 
information based on said Individual stream; 
a storage unit for storing said individual stream: 
first control means for storing a second individ- 
ual stream in said storage unit when second 
corrtrol infonnation correlated with the second 30 
individual stream within said plurality of individ- 
ual streams demultplexed by said demutti- 
plexer satisfies predetermined conditions; 
second control means for extracting said sec- 
orrd individual stream from said storage unit 35 
when first control information correlaed with the 
first individual stream within said plurality of 
individual streams demultiplexed by said 
demultiplexer satisfies predetermined condi- 
tions; and 40 
structuring means for replacing a partial stream 
composing said first individual stream with the 
second irxJividual stream which has been 
extracted by said second control means to be 
structured as a new first individual stream. 4S 

7. The terminal apparatus according to Claim 6, fur- 
ther comprising a terminal information storage unit 
for storing terminal information designated by a 
user; so 
wherein said first control means compares said 
second control information and said terminal infor- 
mation and stores said second individual stream to 
said storage unit in accordance with the result of 
corrparison. 55 

8- The terminal apparatus according to Claim 6. 
wherein said second control means compares said 



first control information and said second control 
information and extracts said second individual 
stream in accordance with the result of comparison. 

9- The terminal apparatus according to any one of 
Claims 6 through 8. wherein said first control infor- 
mation has at least first identification information for 
identifying a partial stream composing said first 
individual stream and processing designating infor- 
mation for designating the processing to be per- 
formed on said partial stream; 

said secorxJ control information has at least 
second Identification Information correlated 
witti the partial stream conposing said first 
individual stream; and 

said second control means extracts said sec- 
ond individual stream correlated with said sec- 
orKl identification information correlated with 
said first identification information when said 
processing specifying Information specifies a 
modifying process. 

10. The terminal apparatus according to Claim 9. 
wherein said processing designating information is 
information for designating at least either one of 
replacing process or a siperposing process: and 

said structuring means replaces said partial 
stream with said second stream when said 
processing designating information designates 
the replacing process arKf superposes said 
partial stream with said second stream as a 
new individual stream when said processing 
designating information designates the super- 
posing process. 

1 1 . A product in which a program for controlling a termi- 
nal apparatus is recorded, connprising: 

demultiplexing means for demultiplexing a 
transmitted multiplexed stream irrto a plurality 
of individual streams; 

first control means for storing a second individ- 
ual sb-eam in a storage unit when second con- 
trol information con^elated with a second 
individual stream witiiin said plurality of individ- 
ual streanns demultiplexed by said demulti- 
plexer means satisfies predetermined 
conditions; 

second control means for extracting said sec- 
ond individual stream from said storage unit 
when first control information correlated with 
the first Individual stream within said plurality of 
individual streams demultiplexed by said 
demultiplexer means satisfies predetermined 
conditions; and 

structuring means for replacing a partial stream 
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composing said first individual stream with the 
second individual stream which has been 
extracted by said second control means to be 
structured as a new first individual stream. 

12. A broadcasting apparatus, comprising: 



5 



first control information appending means for 
correlating first control information per partial 
stream composing a first individual stream; io 
second control information appending means 
for correlating second control information cor- 
related with said first control information per 
second Individual stream; and 
stream generating means for generating a mul- is 
tiplexed stream based on the first individual 
stream composed of partial streams correlated 
with said first control information and the sec- 
ond individual stream correlated with said sec- 
ond control information. 20 

1 3. The broadcasting apparatus according to Claim 1 2, 
wherein said stream generating means generates 
said multiplexed stream such that said second indi- 
vidual stream correlated with said partial stream is 25 
transmitted prior to said partial stream. 

14. The broadcasting apparatus according to Claim 12 
or 13, further comprising a transmitter unit for trans- 
mitting the multiplexed stream generated by said so 
stream generating means to a specific transmitting 
medium. 

15. A digital stream control method, comprising the 
steps of: 35 

controlling an individual stream t>ased on con- 
trol information correlated with the individual 
stream; and 

outputting the individual stream controlled in 40 
said control step to an output unit. 

16. The digital stream control method according to 
Claim 15. wherein said control step comprises a 
step of extracting a second individual stream from a 45 
storage unit based on control information correlated 
with a partial stream composing a first irxiividual 
stream. 

17. The digital stream control method according to so 
Claim 16, wherein saM control step comprises a 
step of structuring a new individual stream by 
replacing a partial stream composing a first individ- 
ual stream by the extracted second individual 
stream. ss 
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